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The Reduction of Families of Bilinear Forms. 

By H. E. Hawkes. 



Introduction 



The problem of determining the necessary and sufficient conditions that two 
families of non-singular bilinear forms are equivalent was first solved by 
Weierstrass in 1868. Since that time the subject has received considerable 
attention from various investigators, notably Frobenius, Kronecker, Weyr and 
Bromwich, but until recently a connected and clear account of this theory has 
been lacking. The work of Bromwich, and in greater measure Bocher's Intro- 
duction to Higher Algebra, have served to supply the deficiency, so that the 
theory cannot now be called inaccessible. 

The present paper gives a direct and practically self-contained derivation of 
the necessary and sufficient condition that two non-singular families of bilinear 
forms are equivalent by a method that is not only simpler of application than the 
classical methods, but well adapted for purposes of exposition. The simplicity 
of the demonstration rests in referring the general question of equivalence of 
families back to that of the similarity of numerical matrices. The question of 
similarity is settled by the derivation of a normal form in which a complete 
system of invariants of a class of matrices is displayed. 

§1- 
Two families of bilinear forms in 2n variables, 

XA + k"B = S(X'« y + 1%)xm, (1) 

(»,/= 1, 2,....,rc) 
XA'+ ?J'B'= £(*'«;. + X%)*[y'j, (2) 

are equivalent when and only when linear transformations, 

x i = Xh a xi \h a \ ^0, 



yj = Zk jk y' k 1^1^:0, 
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exist that will transform (1) into (2). In these families, the parameters a' and a", 
and the coefficients, are assumed to be real or complex numbers. This trans- 
formation may be expressed as follows in the notation of matrices : 

h(a'a + a"b)k = a/a' + a"b', (3) 

where h, a, etc. symbolize the matrices whose determinants are \h a \, |a$|, etc. 
The necessary and sufficient conditions for the validity of (3) are that 

hak = a'; hbk=:b'. (4) 

The sufficiency of these conditions follows immediately from the application 
of the distributive law in operations with matrices; their necessity, from the 
fact that (3) is valid for all values of a' and a". 

We proceed to find a method of determining the conditions under which 
h and k exist; that is, simple means of determining whether (1) and (2) are 
equivalent. Let us first consider the exceptional case when | a | == | b | == ; 
while | a'a + a"b | = | C | ^ 0. For a certain pair of values of a' and a" for which 
the determinant |c| does not vanish, let a'a'+ a"b' = C'. Then if c and c' are 
equivalent, 

hck = c'; and hak = a'. 
Consequently 

k = c _1 h _1 c', and a'= hac^lrV, 

or 

a'c'-^hlac-^h- 1 ; (5) 

thus if C and c' are equivalent, the matrix a'C /_1 is similar* to the matrix ac _1 . 
The converse is also true. For from (5), letting k = C -1 h _1 C', we obtain 
immediately a , = h&k; c> = m 

This criterion also holds in the unexceptional case where at least one of the 
determinants | a | and | b | , say | b | , does not vanish. In this case the condition 
(5) is replaced by the condition 

a'b'-^hfab-^h- 1 . (6) 

The case where |a'a + a"b| = 0, which Kronecker has completely dis- 
cussed, will not be considered in this paper. 

The problem of determining the equivalence of families of bilinear forms 
(1) and (2) is, then, reduced to the problem of determining the similarity of the 
matrices a'c' -1 and ac _1 . It should be observed that the determinant of these 
matrices may be zero. 

* Frobenius defines the matrices a and b to be similar (ahnlich) when a matrix 1 exists such that 
a = lbl _1 . See Orelle, 84, p. 21. 
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§2. 

We may, if we choose, think of all the matrices that are similar to each 
other as forming a class of matrices. If we can determine a complete system 
of invariants for a class of matrices, we shall be in a position to settle the ques- 
tion of the equivalence of bilinear forms that was stated in the last section. As 
a matter of fact, we shall prove that the following constitute such a system for 
a class of matrices under the transformations of similarity: 
I. The rank of any matrix, a, of the class. 
II. The characteristic equation of a. 

III. The degrees of the elementary divisors of the matrix a — a. 

The proof of the first two parts of this statement is very simple and familiar, 
but will be given for the sake of completeness. 

Invariant I. Given a matrix a of order n and rank h. Let b = hah -1 . 
Then since the rank of the product of determinants cannot exceed the lowest 
rank of the factors, the rank of b cannot be greater than that of a. Similarly, 
since a = Ir^bh, and the rank of a cannot exceed that of b. Hence the rank is 
invariant. 

Invariant II. By the characteristic equation of a matrix 

^11 a lZ ^13 • • • • «ln 

a 21 a 22 (% • • • • a 2n 



a = 



is meant the equation of the nth degree in a that one obtains by developing the 
determinant in the equation 

A — a \\ a 12 a 13 a ln 

^21 ^ a 22 ^23 ^2n 

Q31 <fe A — (*33 a Sn 



K%) = 



4 31 



^32 



a„ 



a 



• A 



= 0. 



%1 t *n2 ®n3 ' 

Suppose this equation has the form 

4>(a) = A n + ttiA" -1 + a 2 A n ~ 2 + . . . . +a n = 0. 

The theorem is well-known that the matrix a satisfies this equation identically, 
that is, <|>(a) = 0. From this it follows that the characteristic equation is an 
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invariant of the class of similar matrices. For it is only necessary to show that 
the equation <p(X) = is satisfied identically when hah" -1 is substituted for X. 
This fact appears immediately, for 

<Khah- x ) = (hair 1 )"* ^(halr 1 )'^ 1 -}- . . . . + a n 

= ha n h- J + aM 11 -^-^ . . . . +a B = h^(a)h~ 1 = o.* 

Invariant III. We now proceed to define the elementary divisors of the 
/l-matrix X — a. As we have seen, the determinant of this matrix is a rational 
integral equation in X, and is consequently factorable into n linear factors, 
(a - Wfr - ^(a, - X 3 ) l ° .... (a, - ^) l * , where l x + l s + I, + ....+ l k = n. 
Suppose that (X — J^) 1 ' 1 is the highest power of A, — \ that is contained in all the 
first minors of the determinant |X — a| , that ?{' is the highest exponent of this same 
factor that is found in all the second minors, and that, continuing in the same 
way, ?p is the highest exponent of 1 — h x that is found in all the <rth minors of the 
determinant. Similarly, we may obtain sets of exponents bearing the same 
relation to the other factors of the original determinant, such as 

7' J" Jill 7T 3 . . Jl VI J I jT k 

Now the first differences of these exponents, 

n — h ~ e i> m h = e 2> h — h — e 3> • ■ • • ,l T f — l\ = e T , 
are called the exponents of the elementary divisors of the matrix. The expres- 
sions (Pi— /Li) 61 , (X — /tj)% . . . ., (a — XiY* are called the elementary divisors of the 
matrix a, — a, corresponding to the factor % — \. We can obtain the complete 
set of elementary divisors of the matrix by considering the other factors of the 
characteristic equation. 

We shall, however, be interested chiefly in the exponents e 1} e z , e 3 , It 

appears that if the roots of the characteristic equation and these e's, together 
with their distribution over the various factors, are known, we then know all the 
elementary divisors of the matrix. If, then, we prove that the elementary 
divisors are invariants of a class of Jl-matrices, the only actual addition to our 
two invariants I and II are these e's and their distribution on the various factors 
of the characteristic equation. 

The proof that the elementary divisors of a matrix are invariants of the 
matrix follows from the theorem that the rth minors of the product of two 

*Of course this same demonstration would show that any equation satisfied by a is an invariant of the 
class of matrices. 



Hawees: The Reduction of Families of Bilinear Forms. 105 

determinants are linear in each of the rth minors of the factors. Hence the 
elementary divisors of the matrix k — a, and of any matrix equivalent to it, 
as S (k — a) t = k — b, are the same. 

Now if a and b are similar, k — a and k — b are equivalent, and conversely. 

For suppose that a and b are similar. Then the matrices k — a and k — b 
are equivalent. For if b = hah -1 , then evidently k — b = h(/l — a)h _1 , since 
h/lh -1 = k. Conversely, if X — a and k — b are equivalent, then a and b are 
similar. For, suppose that s(k — a)t = k — b. Since the distributive law holds 
in the operations with matrices, we have sXt— sat = k — b, or since this equa- 
tion is identically true, $kt = k, that is, St = 1, or t = S _1 . Hence b = S _1 aS- 

Consequently in determining whether the matrices mentioned at the end 
of § 1 are similar or not, it is only necessary to discuss the equivalence of the 
corresponding ^-matrices. 

§3. 

This completes the demonstration that I, II and III are invariants of a class 
of matrices. It is a more serious matter to show that they form a complete 
system of invariants. To do this, we shall show how to reduce the matrix a into 
a similar normal form which is completely characterized by the system of 
invariants I, II and III. 

Let the roots of \k — a| = be k u k 2 , k 3 , . . . ., k n , of which suppose that 

the first r are distinct. Let the solutions of the r sets of n linear equations in 

n variables 

Za lk x k = X h xi {I = 1, 2, . . . . , n ; h — 1, 2, . . . . , r) 

k 

be £j w £ 3 ' l) £g l) .... £^\ Build, now, a matrix of the nth order of which the first 
r columns are these £'s, and of which the other elements are all zero excepting those 
in the principal diagonal, which is made up of l's in the places not filled with £'s. 
Call this matrix t Build also t _1 , and carry out the multiplication t -1 at The 
result of this process by which we pass from a to a similar matrix changes the 
form of the matrix materially. In fact, in the new form we have all the ele- 
ments of the first r columns zero except the elements of the principal diagonal, 
which are k lf k % , k 3 , . . . ., k r . In the transformed matrix consider the (n — r)- 
rowed determinant that is common to the last n — r rows and columns. Proceed 
with this exactly as was done with the original matrix, only in the matrix that 
corresponds to t let the elements in the first r columns all be zero except those 
in the principal diagonal that fall in those columns, which we place equal to 1. 
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Continue this process till there are no non-zero elements below the principal 
diagonal, and the principal diagonal consists of the roots of the characteristic 
equation. 

Numerical Example. Let us reduce to normal form the matrix 



a = 



of which the characteristic equation is 

X' — b7? + 9X 2 — n + 2 = 0. 

By taking the derivative of this equation it appears that 1 is a triple root, and 
that 2 is the other root. 

We will first simplify the matrix by bringing 2 to the leading place, and 1 
to the next place in the principal diagonal, making all the other elements of the 
first two columns zero. To this end we get as solutions of the equations 

2x — 2y -f z + w = 2x, 

6a; — Sy + Axo = 2y, 

16x—3y — 42 -f 8w=2z, 
2Sx + 4y — 13z + lOw = 2w 

the values x = 1, y= 2, z = 3, w=\. We must also solve the equations that 
we obtain from these by replacing the right-hand members, viz., 2x, 2y, 2z, 2w, 
by x, y, z, to. The solution of these equations is a;=0, y = — 1, 2 = — 1, 
w = — 1. Now compute the product t _1 at, where 



t = 

and we obtain 



1 















1 








2- 
3- 


- 1 

- 1 




1 






, t-> = 


2— 1 
— 1 — 1 




1 






1 - 


- 1 





1 




1— 1 





1 
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1 


1 












a = 







1 2- 
0— 5 
0—12 


- 2 
3 
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• 
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Now solving the equations 



ti = 



and we obtain 



a = 



— 5x -j- Sy = x, 


-12a; + ly = y, 


n compute tf^ti, 


1 





1 








1 





2 1 


2 


1 1 


1- 


-2—2 





1 3 





1 



From the results that we shall obtain in the next paragraphs it appears that we 
may replace the last two elements in the first row, and the last element in the 
second row, by without further transformation. The — 2 and the 3 may be 
replaced by 1, and we have the result 



2 














1 


1 











1 


1 











1 



a = 



Now if a non-zero element, say a ik , occurs in the intersection of the ith row, 
and the Mh column, and if the roots \ and X k are distinct, this element 
may be replaced by zero without otherwise disturbing the matrix. For 
build the matrices h and h" 1 each of which have all the elements in their 
principal diagonal equal to 1, and which have all the other elements equal to 
zero except that in the iih row and the Jcth. column, where the values h and — h 



a 



The transformation h J ah does not 



respectively occur, where h = .. — 1 ~- 

M — ^k 

change the elements of any row above or below the ith, and only the element a ik 
in that row, which it replaces by 0. 

Consequently, since we can always find a transformation that will replace 
such elements a ik , (/If^:^) by zero without disturbing the rest of the matrix, 
there is no necessity of going through the transformation at all, but the elements 
may be replaced by zero as soon as the previous transformations are completed. 
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We may now, by an interchange of rows and columns, which in the present 
form of matrix is equivalent to passing to a similar matrix, bring into juxta- 
position along the principal diagonal all the roots that are equal to each other. 
We have then a matrix of the form 



a = 



a, 





. . 


.. 





a 2 


.. 


.. 








a 3 -- 


.. 



(7) 



o o o .... a* 

where a^ represents a submatrix all of whose roots are equal, and in which all 
the elements below the principal diagonal are zero. 

§4- 
We may then for the further reduction of the matrix confine ourselves to 
the consideration of a matrix all of whose roots are equal, and which is in the 
form 

A, &\9 W'lQ • • • • (v] 



a,= 



V 1Z "18 

o a, a,, s 
1 



n»i 



a, 



'2m 



Hr.i 



oo o a 

where "k is taken to represent any one of the distinct roots "k u X 3 , . . . • , "k k . We 
now seek a method of further reducing matrices of this type. To effect this 
reduction we may use transformations of three types. 

First, we may effect an interchange of the subscripts i and/; that is, we may 
carry out the substitution (ij) on the subscripts by transforming 8i by the matrix 
h in which h v = h n = 1 = Ji kk , (k dp i, j), and all the other elements are zero. 
Since the transformation is known always to exist, of course the indices may be 
interchanged without actually going through the transformation. 

Second, if a u ^ 0, and at the same time (fy_ w dp. 0, we may transform &i by 
h, where h kk = 1 and all the other elements are zero excepting /? tf _i, which has 
the value a^ja^. This transformation has the effect of replacing a v by zero, 
but not affecting the remainder of the matrix excepting certain elements in the 
first i — 1 rows. 

Third, if (tydp.0, and at the same time aj_y = Q, but a ii+1 dp 0, we may 
transform the matrix ai by a transformation of the first type so that a ti falls in 
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the place that was occupied by a ii+2 , and is, as a consequence, directly over a 
zero element. Now transform the matrix by a transformation h such that 
h kk =zl and all the other elements are zero excepting A i+2i+1 , which has the 
value — «ii + i/%. The effect of this transformation is to replace % +1 by zero, 
and to leave all the other elements in the matrix unchanged with the exception 
of certain elements that occur in the first i — 1 rows. 

By the use of these transformations we are able to start with the last row, 
and gradually replace all the elements by zero, excepting certain elements that 
we can always put in the place of the elements % +1 , and which constitute what 
we will call the over-principal diagonal. By a simple transformation these 
elements may all be replaced by unity, so that our matrix ai assumes a form in 
which every element is zero excepting the elements of the principal diagonal, 
which are all equal to A, and the elements of the over-principal diagonal, which 
are all either 1 or 0. This is the normal form for which we were seeking. It 
appears that any matrix can be brought to this form by properly chosen trans- 
formations, and consequently that every matrix is similar to some matrix which 
is in normal form. It is observed that the matrices that we have considered 
need not necessarily have the rank n, but the characteristic equation may have 
zero roots without affecting the method in the least. 

The transformation employed in obtaining the form (7) assumed that 
the characteristic equation had been solved. If this equation is irreducible 
in the domain of rational numbers, this process is an irrational one. Since the 
objection to the irrational process is partly a practical one, it is worth while to 
observe how serious these irrational operations are, practically. In the first 
place, if there are no multiple roots in the characteristic equation, the fact is 
determined rationally, and in such a case no reduction is ever necessary, as each 
of the subdeterminants a< in (7) reduces to a single element, and the equiva- 
lence hinges on the identity of the characteristic equations themselves, which 
is surely determined by a rational process. For the case n = 3 there can be no 
irrational multiple root. In the case n = 4, the only possibility of having an 
irrational multiple root is when the characteristic equation is a perfect square; 
that is, when there are two pairs of conjugate quadratic surd or complex roots. 
No irrationalities of the third order will be encountered in the reduction of any 
matrix of lower order than the ninth, and then only when the characteristic 
equation is a perfect cube; and a matrix of order twenty-five would be the first 
that would involve non-algebraic irrationalities. 
15 
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The submatrices in the previous numerical example that correspond to equal 
roots of the characteristic equation are so simple that it is worth while to give 
another numerical example of a rather more complicated character. In con- 
sidering the following matrix of order six, with six equal roots, it is to be noted 
that the value of "k is assumed to be 1. 



aj = 



Transforming by h where all the elements of h are zero except those in the 
principal diagonal, and the element h 66 , all of which have the value 1, we obtain 

1 1 1—3—2—7 



a, = 



This is a transformation of the third type. 

Interchanging, now, the elements that should be moved when the subscripts 
5 and 6 are interchanged, we have 



ai = 



Transforming this matrix by h where all the elements of h are zero except- 
ing those in the principal diagonal, and the element A 34l all of which have the 
value 1, we obtain 



ai = 



This and the following transformation are of the second type. 
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Transforming this matrix by h, where all the elements of h are zero ex- 
cepting those in the principal diagonal, which have the value 1, and h u which 
has the value 5, we obtain 
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Interchanging the elements corresponding to an interchange of the sub- 
scripts 4 and 6, followed by the interchange of 5 and 6, we obtain 
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ai = 
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Transforming this matrix 


byh, 


whe 


re the 


) pr 


incipal diagonal consists of l's 


and A 43 = £, we get 
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This is a transformation of the third type. 

From the nature of the transformations employed it is clear that we may 
get rid of elements without disturbing the rest of the matrix, so that the normal 
form of the matrix is finally 
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It is easy to see that the necessary and sufficient condition that two matrices 
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are similar is that they are reducible to the same normal form. Furthermore, it 
appears that if we know the rank of a matrix and the roots of its characteristic 
equation, that is if we have the first two of the invariants mentioned in § 2, we 
can fix exactly every feature of the normal form of that matrix excepting the 
arrangement of the l's along the over-principal diagonal. If, then, we can show 
that the way these group themselves is determined by the values of the 
exponents of the elementary divisors, we shall be able to pronounce the set of 
three invariants a complete system for the class of matrices. 
Let the matrix ai have the following form : 




a, 

where zeros fill the places left blank, and where the e's represent the number of 
consecutive l's in the various groups of l's in the over-principal diagonal. 

Suppose that the order of subscripts is so chosen that e x > e % > >e A . Then 

we can show that these e's are precisely the exponents of the elementary 
divisors that constitute one of the three invariants mentioned. 

Since the matrix "k — a x only differs from the matrix a^ in having the ele- 
ments X replaced by the elements 7i— \ all along the principal diagonal, we may 
observe the relation between the elementary divisors and the way the l's are 
arranged as well from the matrix 3i that we have just written as from the 
matrix "k — 8i. We wish to observe the highest common factor of the subdeter- 
minants of the various orders of a^ Consider the highest power of >l — \ that 
occurs in all the non- vanishing first minors of /I — a x . Evidently the first minors 
with respect to the elements above the principal diagonal vanish, since all the 
elements below the principal diagonal of such a minor, and at least one element 
in the principal diagonal, are zero. The minor with respect to an element in the 
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principal diagonal has the value (A.— \) m ~ l , where m is the order of a^ If in 
forming a first minor with respect to an element below the principal diagonal, 
one of the zeros that separate the sets of consecutive l's is inside the right angle 
formed by the row and column that are deleted to form the first minor in ques- 
tion, then that zero is introduced into the principal diagonal of the first minor, 
which, therefore, vanishes. Consequently, the only elements of h x whose minors 
do not vanish are those whose rows and columns contain only consecutive l's 
from the over-principal diagonal of 8i inside the right angle formed by those 
rows and columns. Consequently the minimum degree of any non-vanishing first 
minor in a, — \ is m — e v Similarly the minimum degree of 51 — \ in the 2nd, 

3rd, .... minors is m~-(e 1 -{-e. 2 ) y m— (e 1 +e 2 4-e 3 ), Evidently the first difference 

of these numbers are e lf e 2 , e 3 ,. . . .; that is, the c's are the exponents of the 
elementary divisors with respect to the root \. In a precisely similar manner 
we could find corresponding numbers for the other roots of the characteristic 
equation of the original matrix a. The e's of our normal form are, therefore, 
the exponents of the elementary divisors of the matrix. 

We have, as the result of the paper up to the present, the 

Theorem. The necessary and sufficient condition that the two non-singular 

families of bilinear forms 

X'A + TJ'B, (1) 

XA'+ ti'B' (2) 

are equivalent, is that the matrices corresponding to the forms 

X — AB~\ 
a, - A'B'- 1 

have, as their complete system of invariants under the similarity transformation, 
(I) their order, (II) the roots of their characteristic equations, (III) the expo- 
nents of their elementary divisors. 

These three invariants may be included in one invariant; namely, the 
elementary divisors of the matrices of these forms. 

§5. 
We proceed to show that the necessary and sufficient condition that the two 
non-singular families 71 A + TJ'B and XA' + JJ'B' are equivalent is that their 
own elementary divisors are identical. The necessity of this condition is shown 
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in the same way as the invariance of the elementary divisors of a matrix was 
shown at the end of § 2, and will not be repeated here.* 

It also appears immediately that if the matrices ab" 1 and a'b' -1 have 
identical elementary divisors, then (1) and (2) also have identical elementary 
divisors. For then ab -1 and a'b' -1 are similar, hence (l) and (2) are equivalent, 
and have the same elementary divisors. It only remains to show that if (1) 
and (2) have equal elementary divisors, then ab -1 and a'b' -1 also have equal 
elementary divisors. 

Let ab -1 = n, and consider the family ^n + V We assume that n is in 
normal form. This family is equivalent to (1) by the criterion derived in § 1. 

Now if the matrix of this family ^n + \ is written out, it is observed that 
the principal diagonal consists of elements of the form A 1 /l i + X 2 , where the \ are 
roots of the characteristic equation of the matrix ab -1 , and the over-principal 
diagonal consists of unit elements or zeros, in the same order as they occur in 
the over-principal diagonal of the matrix n. That is to say, we have here a 
form of the matrix of the family of (1) that displays its elementary divisors in 
just the same way as the elementary divisors of ab -1 are displayed in n. It is, 
in fact, a normal form for (1), and it appears that the exponents of the elementary 
divisors for n are the same as those for (l). Consequently, when we find the 
normal form for ab -1 , we are simultaneously finding the normal form (1), and if 
(1) is known to have certain elementary divisors, we can write down without 
further discussion the elementary divisors of ab -1 , for their exponents are 
identical. Consequently, if (1) and (2) have the same elementary divisors, ab -1 
and a'b' -1 also have the same elementary divisors, and (1) and (2) are therefore 
equivalent. This is Weierstrass's great theorem. 

Practically to determine whether two families of bilinear forms of the types 
(1) and (2) are equivalent, we must build the matrices ab -1 and a'b' -1 , and reduce 
both of these matrices to their normal form. If they have identical (I) rank, (II) 
characteristic equations, (III) exponents of their elementary divisors, then (1) 
and (2) are equivalent. It is to be observed that if invariants (I) or (II) of 
the two matrices differ, the fact is always noticed before any reduction is made, 
and the fact of inequivalence is shown without the labor of reduction. 

Tale University, December 11, 1908. 

*For a detailed proof of this fact see Bficher, Introduction to Higher Algebra. 



